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We identify a unifying measure for stochastic resonance (SR) in voltage dependent ion channels 
which comprises periodic (conventional), aperiodic and nonstationary SR. Within a simplest setting, 
the gating dynamics is governed by two-state conductance fluctuations, which switch at random time 
points between two values. The corresponding continuous time point process is analyzed by virtue 
of information theory. In pursuing this goal we evaluate for our dynamics the r -information, the 
mutual information and the rate of information gain. As a main result we find an analytical for- 
mula for the rate of information gain that solely involves the probability of the two channel states 
and their noise averaged rates. For small voltage signals it simplifies to a handy expression. Our 
findings are applied to study SR in a potassium channel. We find that SR occurs only when the 
closed state is predominantly dwelled. Upon increasing the probability for the open channel state 
the application of an extra dose of noise monotonically deteriorates the rate of information gain, 
i.e., no SR behavior occurs. 



PACS number(s): 05.40.-a, 02.50.Wp, 87.10.+e, 87.16.-b 



I. INTRODUCTION 

The stochastic resonance (SR) constitutes a cooper- 
ative phenomenon wherein the addition of noise to the 
information carrying signal can improve in a paradox- 
ical manner the detection and transduction of signals 
in nonlinear systems (see, e.g., |l[ for an introductory 
overview and B for a comprehensive survey and refer- 
ences). Clearly, this effect could play a prominent role for 
the function of sensory biology. As such, the beneficial 
role of ambient and external noises has been addressed 
not only theoretically (see, e.g., j|), but also has been 
manifested experimentally on different levels of biologi- 
cal organization - e.g., in the human visual perception 
M and tactile sensation H , in the cricket cereal sensory 
systems gj] , or also in the mammalian neuronal networks 
J7J and - even earlier - for the mechanoreceptive system 
in crayfish j8[ . Presumably, the molecular mechanisms of 
the biological SR have their roots in stochastic properties 
of the ion channel arrays of the receptor cell membranes 
[|jj . This stimulates the interest to study SR in biological 
ion channels. One of the outstanding challenges in SR- 
research therefore is the quest to answer whether - and 
how - SR occurs in single and/or coupled ion channels. 

These channels are the evolution's solution of enabling 
membranes made out of fat to participate in electrical 
signaling. They are formed of special membrane pro- 
teins ||. In spite of the great diversity, these natural 
occurring nanotubes share some common features. Most 
importantly, the channels are functionally bistable, i.e. 
they are either open, allowing specific ions to cross the 
membrane, or are closed B. The regulation of the ion 
flow is achieved by means of the so-called gating dynam- 
ics, i.e., those intrinsic stochastic transitions occurring 
inside the ion channel that regulate the dynamics of open 
and closed states. The key feature of gating dynam- 



ics is that the opening-closing transition rates depend 
strongly on external factors such as the membrane po- 
tential (voltage-gated ion channels), membrane tension 
(mechanosensitive ion channels), or presence of chemi- 
cal ligands (ligand-gated ion channels). This sensitivity 
allows one to look upon the corresponding ion channels 
as a kind of single-molecular sensors which transmits an 
input information to the signal-modulated ion current 
response. 

Recently, it has been demonstrated experimentally by 
Bezrukov and Vodyanoy [H]] that a parallel ensemble 
of independent, although artificial (alamethicin) voltage- 
gated ion channels does exhibit SR behavior, when the 
information-carrying voltage signal is perturbed by a 
noisy component. These authors have put forward the 
so-called non- dynamical model of SR. It is based on the 
statistical analysis of the " doubly stochastic" , periodi- 
cally driven Poisson process with corresponding voltage- 
dependent spiking rate [10 11 1. Conceptually, such a 
model can be adequate to those situations only where 
the channel is closed on average with openings constitut- 
ing relatively rare events. An experimental challenge is 
to verify whether the SR effect persists for single natural 
biological ion channels under realistic conditions. More- 
over, a second challenge is to extend the theoretical de- 
scription in jll[ to account properly for the distribution 
of dwell times spent by the channel in the conducting 
state. 

The previous research on SR in ion channels has ex- 
clusively been restricted to the case of conventional SR, 
i.e., SR with a periodic input signal. In a more general 
situation, however, input aperiodic signals can be drawn 
from some statistical distribution. This case of the so- 
termed aperiodic SR has recently been put forward for 
neuronal systems [g||lj-|lj] . Note that the important as- 
sumption of dealing with a signal realization that is taken 



from a stationary process has been made in all previous 
studies. In practice, however, one frequently meets a 
situation where this stationarity assumption is not rig- 
orously valid, because the signal has a finite duration on 
the time-scale set by observation. In this nonstationary 
situation, both the spectral and the cross-correlation SR 
measures are inadequate. A preferable approach is then 
to look for SR from the perspective of statistical infor- 
mation transduction |fl jl4|. As is elucidated with this 
work, information theory |15[| can indeed provide a uni- 
fied framework to address different types of SR, including 
nonstationary SR. It is the main purpose of this work to 
investigate the possibility to enhance the transmission of 
information in a single ion channel in presence of a dose 
of noise. This task will be accomplished within a simplis- 
tic two-state Markovian model for the ion channel con- 
ductance P]. Already within such an idealization, our 
analysis in terms of information theory measures turns 
out to be rather involved. 



II. TWO-STATE MODEL 

In principle, the microscopic description of the gat- 
ing dynamics should be based upon the detailed under- 
standing of the structure of channel's "gating dynamics" . 
Present state of the art assumes that the voltage-sensitive 
gates are represented by mobile charged a - helix frag- 
ments of the channel protein which can dynamically block 
the ion conducting pathway. Therefore, the gating dy- 
namics can be described by diffusive motion of gating 
"particles" in an effective potential. Then, Kramers dif- 
fusion theory [ fU3|Jl7| ] and its extension to the realm of 
fluctuating barriers (see, e.g., [ |L8f for a review and fur- 
ther references) can be utilized to describe the gating 
dynamics. Such a type of procedure, however, is still 
in its infancy p9J ], For our purpose, it suffices to follow 
a well-established phcnomenological road provided by a 
discrete phenomenological modeling |20|. 

The simplest two-state model of this kind reflects the 
functional bistability of ion channels. The dichotomous 
fluctuations between the conducting and nonconducting 
conformations of single ion channels are clearly seen in 
the patch clamp experiments (g0[. The statistical distri- 
butions of sojourn times of the open channel state and 
the closed channel state, respectively, are generically not 
exponentially distributed fl20fl . However, one can charac- 
terize these time distributions by its average, < T (V) >, 
to dwell the open (O) state, and by its corresponding av- 
erage, < T C (V) >, to stay in the closed (C) state. These 
two averages depend on the transmembrane voltage V. 
Then, the actual multistate gating dynamics can be ap- 
proximately mapped onto the effective two-state dynam- 
ics described by the simple kinetic scheme 
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with corresponding voltage-dependent effective transi- 
tion rates k c {V) = 1/ < T (V) > and k (V) = 1/ < 
T C (V) >, respectively. Although such a two-state Markov 
description presents a rather crude approximation, it 
captures the main features of gating dynamics of the 
voltage-sensitive ion channels - the dichotomous nature 
and the voltage-dependence of transition rates. More- 
over, this model yields by construction the correct mean 
open (closed) dwell times, and the stationary probability 
for the channel to stay open, i.e. P (V) =< T (V) > /(< 
T (V) > + < T C {V) >). An example for the experimen- 
tal dependence of the transition rates on voltage V can 
be found for a K + channel in Ref. pl|,p2f and is depicted 
in Fig. H We note that in contrast to the closing rate 
the effective opening rate has no exponential dependence 
on the voltage. Thus, these two rates are not symmet- 
ric (with respect to dependence on V, cf. Fig. 1). The 
reason being that the two-state description results as the 
reduction of an intrinsic multistate (or multi-well) gating 
dynamics and thus presents only a shadow of real behav- 
ior. In this sense, the Markovian approximation models 
the true non-Markovian dynamics on a coarse grained 
time scale. 

To proceed, one has to generalize this working model 
to the case with time-dependent voltages V(t) — V~o + 
V s (t) + V n (t) . Here we distinguish among three compo- 
nents of the voltage: (i) the constant bias voltage Vq, (ii) 
some time-dependent, unbiased signal V s (t), and (iii) a 
noisy component voltage V n (t). The noisy voltage V n (t) 
is assumed to be a stationary Gaussian Markovian noise 
with zero average and root mean squared (r.m.s.) ampli- 
tude a. Moreover, it possesses a frequency bandwidth f n . 
Let us restrict our treatment to the situation where both 
the signal and the external noise are slowly varying on 
the time-scale set by diffusive motions occurring within 
the open (or closed) conformation. This time-scale T con 
typically lies in the /isec range as manifested experimen- 
tally by the fast events in channel activation] 19] . We 
thus can apply the fluctuating rate model [|l|,|ll| assum- 
ing that the transition rates fc ( c )(t) = k ^ c )\V(t)] follows 
adiabatically the voltage V(t). Furthermore, we assume 
that the applied Gaussian voltage V n (t) presents effec- 
tively "white-noise" on the time scale set by the decay 
of autocorrelations of the ion current fluctuations. The 
autocorrelation time n = l/[k (Vo) + k c (Vo)] is typically 
of the order of milliseconds pOf . Then, the choice of a 
noise bandwidth /„ satisfying tJ <C f n <C T com i- e -j 
/„ ~ 10 — 100 kHz, presents a consistent specification 
for the fluctuating rate description. The role of exter- 
nal noise is thus reduced within the same two-state ap- 
proximation merely to forming new, noise-dressed time- 
dependent transition rates k a — , c (t) — (k a =o,c[V(t)]) n . 
They result by taking the stochastic average of the fluc- 
tuating rates over the external noise. These effective rates 
depend now on the noise r.m.s. amplitude c, the static 
voltage Vq and the time-dependent signal V s (t). It turns 



out that within in the given approximation the averaged 
transition rates do not depend on the noise bandwidth 
f n , see also Appendix A. 

Our model for the channel dynamics thus reads 



< n < r 2 < ... < t s < t. 



(3) 



dP {t) 

dt 
dP c (t) 

dt 



= -k c {t)P (t) + k (t)P (t), 

= -k (t)Pc{t) + k c (t)P (t), 



(i) 



where P (t), and P c (t) denote the time-dependent prob- 
abilities for a single ion channel to be open or closed, 
respectively. The stochastic process described by Eq. 
(|l|) is a nonstationary random telegraph noise (RTN) 
with time-dependent transition rates. This model has ex- 
tensively been studied in the literature, for example, to 
model conventional S R [pp jl. Moreover, this model has 
been studied in Ref. p4|| from the perspective of input- 
output cross-correlations as a simple model for aperiodic 
SR. However, to the best of our knowledge the detailed 
analysis of this cornerstone model from the perspective to 
use information theory [IJjjlJ] to specify the information 
transduction process is still lacking. 



III. STATISTICAL DISTRIBUTION OF 
CURRENT FLUCTUATIONS 

How can we estimate the amount of information trans- 
mitted from the input voltage signal V s (t) to the output 
ion current /(£)? A comparative statistical analysis of the 
ion current fluctuations performed in the absence and in 
the presence of signal allows one to answer this question. 

When the channel is open a large number of ions cross 
the channel; thus creating a finite current I (t). This cur- 
rent obeys the Ohmic law, I (t) — g [V(i) — Vk], where 
g is the conductivity of the open channel and Vk is the 
"reversal" potential (Nernst potential) for K + ion flow. 
When the channel is closed, the ion flow is negligible and 
the current is zero. We recall that the current passing 
through the open channel is generally time-dependent in 
accordance with the externally applied signal V s (t). How- 
ever, we will assume that the information about signal is 
encoded in the switching events of current between zero 
and I (t), and not in the additional modulation of I {t). 
In other words, the information is assumed to be en- 
coded in the signal-modulated conductance fluctuations 
between g and zero |2J| . 

Moreover, one can describe the resulting current fluc- 
tuations in terms of conductance fluctuations, i.e., 



I(t)=g(t)[V(t)-Vk] 



(2) 



wherein g(t) as a two-state random point process p6| , [27J |. 
The sample space of g(t) within the time interval [0,t] 
consists of stochastic trajectories which flip between zero 
and go at randomly distributed switch-time points T{, i 
= 1,2,...; i.e., 



This defines a continuous time point process r(f), < i < 
t. Next, we divide the sample space into two subspaces: 
(i) the subspace "o" contains all trajectories which fin- 
ish in the open state at the end point t of the consid- 
ered time interval, and (ii) the subspace "c" which con- 
tains all trajectories which end in the closed state, re- 
spectively. Furthermore, within each subspace the tra- 
jectories are divided into the subclasses described by the 
number s = 0, 1, 2, ... which enumerates the number of in- 
termediate flips that occurred between open and closed 
states in order to arrive at the final state. The proba- 
bility distribution on this space is given by a sequence 

of joint multi-time probability densities Q c s (£,t s , ..,ti) 
for switches to occur at time n, t 2 , ••••, t s and to end up 
at time t in either the open state o or closed state c, re- 
spectively. This probability distribution is normalized; 



E lQo(t) 



E 



dr s / dr s _i.. 
o Jo 



: [ 2 dT 1 Q a s {t,T s ,..,T 1 )] = l 

Jo 



(4) 



A°)t 



The probability densities Q s (£,t s ,..,ti) are readily 
constructed by taking into account the facts that the 
process g(t) is (semi-) Mar kovian for any given realiza- 
tion of the voltage signal V s (t) with the switching time 
points Ti being drawn alternatingly from two different 
time- dependent Poisson distributions (27J. In particular, 
the probability to stay in the closed conformation until 
time t, given that this conformation has been occupied 
initially with the probability P c (0), is 



Ql{t)=e~$>° (T)dT P c {0) 



(5) 



To obtain the remaining probability densities, we intro- 
duce the conditional probability density 



P, 



I I \ T I \ ~ f X2 k °( T ) dT 

(t 2 |ti) = fc (r 2 )e Jt i 



(6) 



for leaving the state "c" in the time interval [r 2 + di, t 2 ] 
given that this state was occupied with probability one 
at t = t\. Analogous expressions, with indices changed 
from "c" to "o" , hold obviously also for the complemen- 
tary quantities Qo{t) and -P (t 2 |ti). Then, the multi-time 
probability densities emerge as 



- V 

,Ti) = e J -; 



k (r)dT 



Q 2 „(A r 2n,-..,Tl) = e J -2„ Po{T2n\T2n-l) 

xP c (t 2 „_ 1 |t 2 „_ 2 )...P o (t 2 |t 1 )P c (t 1 |0)P c (0) , (7) 
for a given even number of flips, and 

- [' k (r)dT 

Q2n+l(*» T 2n+l,-,n) = e Jt2 "+i P (t 2 „+i |t 2 „) 

xP c (t 2 „|t2„-i)...Pc(t 2 |ti)P o (ti|0)P o (0) , (8) 



for odd number of flips, respectively. The probability 
densities for the other subspace ending in the open state 
(labeled with "o" ) can be written down by use of a simple 
interchange of the indices "c" and "o" in Eqs. (Q) - (ph. 
The above reasoning yields a complete probabilistic de- 
scription of the stochastic switching process that is re- 
lated to the conductance fluctuations g(t). In terms of 
the stochastic path description, the probability that the 
channel is open at the instant time t is therefore given 
by 



00 ft fT s 

I dr s 
Jo 



Po{t) = Q° {t) +J2 dT * / S dT s-l 



s=l 



T2 



x dnQ°(t,T a ,..,n). (9) 
Jo 

An analogous expression holds also for the probability 
of the closed conformation P c (t). Upon differentiating 
P (t) and P c {t) with respect to time t one can check that 
these time-dependent probabilities indeed satisfy the ki- 
netic equations (pi). 



IV. STOCHASTIC RESONANCE QUANTIFIED 
BY INFORMATION THEORY 

In the following we derive the general theory for var- 
ious information measures that can be used to quantify 
the information gain obtained from an input signal V s (t) 
being transduced by the ion channel current realizations 
Ii (t) when V s (t) is switched on, versus the case with V s (t) 
being switched off. Intuitively, this information describes 
the difference in uncertainty about the current realiza- 
tions in the absence and in the presence of the signal 

v s (t). 



A. Preliminaries 

We start out by reviewing the necessary background. 
Let us first consider a discrete random variable A. As 
demonstrated by K. Shannon in 1948 [|15| (his expression 
was discovered independently by N. Wiener), the infor- 
mation entropy 



S(A) = -K^pjlnpi 



(10) 



provides a measure for the uncertainty about a partic- 
ular realization Ai of A J2g]. In Eq. (|l0|) , the set pi 
denotes the normalized probabilities for the realizations 
Ai to occur, Y]"—i Pi = 1. The positive constant n in (nfl) 
defines the unit used in measurement. If the information 
entropy is measured in binary units, then k = l/ln2, 
natural units yield k = 1, and digits give k = 1/lnlO. 
This measure attains a minimum (being zero) if and only 
if one pi = 1 for a particular value of i, and all others 



satisfying pi — 0. It reaches a maximum if p t = l/n. 
The information entropy for a probability distribution is 
therefore a measure of how strongly it is peaked about a 
given alternative. The uncertainty is consequently large 
for spread out distributions and small for concentrated 
ones. 

The application of an external signal (perturbation) 
results in a change of probabilities pi and consequently 
in entropy S(A). The gained information X is then de- 
fined by the corresponding change in entropy, i.e. 2 = 

^before ^after- 

The generalization of the information concept onto the 
case of continuous variable A{x) presents no principal dif- 
ficulties. In this case a proper definition of entropy reads 



S(A) = — k / p(x) hi[p(x)Ax]dx 

= — k / p(x) \n[p(x)]dx — Kin Ax; (11) 



wherein p(x) is the probability density and Ax denotes 
the precision with which the variable A(x) can be mea- 
sured (coarse graining of cell size). As is clearly seen from 
Eq. (O), the absolute entropy of a continuous variable is 
not well defined since it diverges in the limit Ax — > 0. 
Nevertheless, the entropy difference := information is 
well-defined and does not depend on the precision Ax. 



B. r-Information 

The generalization of information theory onto the case 
of stochastic processes is not trivial. In our case, the 
proper definition of entropy of the switch-point process 
r(t), considered on the time interval [0, T], is - by anal- 
ogy with Eq. (|l|) - 

S t [T\V s ]^-k J2 {Qo(T) In Q a {T) 

a—o,c 

+ Y, dT * dr._i... / dnQZ{T,T s ,..,n) 
s=1 Jo Jo Jo 

xln[Q«(T,r s ,..,r 1 )(Ar) s ]}, (12) 

where At denotes the precision of time measurement, 
and the symbol V s indicates that the entropy is defined 
in presence of the signal V s (f) . The presence of the time 
resolution At in (n3) gives the name "r-entropy" to this 
quantity |29|] . It is very important that in the contrast 
to the case of a continuous variable, the contribution of 
the finite time resolution At to the r-entropy cannot 
be recasted in a form like —Kin Ax, cf. Eq. (pT|). We 
note that its contribution depends on the statistics of the 
random process, being different in the presence and in 
the absence of signal. This is why not only the absolute 
entropy, but also the difference of entropies become not 
well defined for continuous time point random processes. 



As a result, the definition of information in this manner 
becomes rather ambiguous. 

For a sufficiently large time interval T the averaged in- 
formation transferred per unit time from the input volt- 
age signal V s (t) to the output current signal I(t) can be 
defined as follows fMBll 



I T 



S T (T\V s =0)-S T (T\V s ) 
T 



(13) 



This information measure can be termed r-information 
per unit time to underline its dependence on the time 
resolution Ar. Upon taking the derivative of 5 T [t|V^] in 
Eq. ( |12| ) with respect to time t we obtain after some 
involved algebra (cf. Appendix B) the result 



dS r [t\Vs] 

dt 



a=o,c 



fc a (t)ln(fc Q (t)Ar/e)p a (t) , (14) 



where a — o, if a = c and vice versa. Together with 
Eq. (jlj) and the definition (|13|) the prominent result in 
Eq. ( pT[ ) allows one to express the r-information for arbi- 
trary signal V s (t) through straightforward quadratures. 
The r-information concept has been used in fact to an- 
alyze the information transfer in neuronal systems in Ref. 
|50|,[n]]. However, the strong dependence of r-information 
on the time precision Ar [ pl| presents surely an undesir- 
able subjective feature. In search for objective information 
measures we consider the information transfer in terms 
of the mutual information measure. 



C. Mutual information 

To introduce the reader to the mutual information con- 
cept, we follow the reasoning of Shannon fll5fl : the signals 
V s (t) are drawn from some statistical distribution char- 
acterized by the probability density functional P[V S (£)]. 
Noting that the probability densities Q%(t,T s , ..., t\) in 
Eqs. (pi), (m) and (m are in fact conditional with re- 
spect to the given realization of V s (t), one can define 
the joint probability densities, Q a ^ ln t (*> r s > —> T i '•> K (*)) = 
Qg(t,T s ,...,Tx)P[V s (t)] for the corresponding stochastic 
processes V s (i) and I(t). Moreover, one can define the 
averaged probability densities (Qg(t,T s , ...,Ti)) s i gn al f° r 
the process I(t) in the presence of the process V s (t), where 
the path integral (...) signa i = j W s (t)...P[V s (t)} denotes 
stochastic averaging over the signal realizations. The mu- 
tual information between the stochastic process V s (t) and 
I(t) can then be defined as the entropy difference 



Mt{V s ,I) = S av (T) - (S r {T\V s )) signa i, 



(15) 



where S av (T) is the r-entropy of the averaged process de- 
fined similarly to dl2) , but with the averaged probability 
densities (Qf (t, n, ..., T s )) s ig na i- Note that making use of 
the Bayes rules one can transform the definition ( |l5| ) into 
a form which makes transparent the fact that the mutual 



information A4t(V s ,I) is a symmetric functional of the 
processes V s (t) and I(t) and provides a nonlinear cross- 
correlation measure between them |ll|. We, however, 
will take advantage of an equivalent form; it is obtained 
from Eq. ([l5]) by using Eq. ( |l2| ) , yielding 

Qo(T) 



Mt(V s J)=k( Yl { Q o( T ) ln 7^ 
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I J I signal 



(16) 



As is clearly deduced from Eq. (|l5|), Shannon's mutual 
information does not depend - due to its skillful defi- 
nition in Eq. ( |15| ) - on the time resolution Ar. This 
underpins its advantage over the information measure in 
Eq. (n3|). Moreover, the functional form ( J16J ) inherits 
important connections between the mutual information 
and another prominent information measure - the (rel- 
ative) Kullback entropy or termed also the information 
gain. 



D. Rate of Information gain 

The information gain |32] is given in terms of the rel- 
ative entropy of the given statistical distribution with 
respect to some reference distribution. In our case, the 
reference distribution corresponds to the stationary ion 
current fluctuations in the absence of the voltage signal 
V 3 (t) . For a given signal V s (t) the information gain reads 



Kt[I\V.]=k ]T JQOT In 



Qo(T) 

Qo° )a (T) 



oo -t 

/() 



8 = 1 



x In 



J2 dr s s dT.-i... / dnQ?(T,T e ,..,Ti) 



Qg(r,T B ,..,n) 

Q 8 0)a (T,r s ,..,n) 



}■ 



(17) 



J0)a 



where the index "(0)" in Q s refers to the case when 
no voltage signal is applied. The relative entropy can 
be regarded as the signal-induced deviation of entropy of 
the random point process r(t) from its stationary value 
obtained in the absence of signal. Although the absolute 
entropy of such a switch-time point process r(t) depends 
strongly on the time resolution Ar and thus is not well- 
defined, the deviation of entropy from the steady-state 
value can be defined independently of Ar via Eq. (|l7|). 
For stochastic processes this relative entropy plays the 
role similar to the entropy difference; thus characterizing 
an information measure. This justifies its given name - 
the information gain. In contrast to mutual information 
this measure can be defined for deterministic signals as 
well. Consequently, the information gain can be used 



as an information measure both for conventional and for 
aperiodic SR. Moreover, this measure is also well-defined 
for nonstationary signals and therefore can be used to 
quantify nonstationary SR as well. 

In contrast to the information gain the mutual infor- 
mation is more difficult to handle analytically. This is 
rooted in the fact that the averaged point process r(i) is 
non-Markovian process with corresponding joint proba- 
bilities not factorizing into products of conditional prob- 
abilities. 

The following important inequality can be deduced 



Mt(V s ,I)=(ICt[I\V s } 

< (jc T [i\v s 



signal 



signal 



K, T [{I) 



signal \ 



(18) 



In Eq. (|18|), Kt[{I) signal] > is the relative entropy of 
the averaged process g(t) defined similarly to Eq. ( |17| ), 
but with the averaged multi-time probability densities 
(Qs(T,T a ,:,Ti)) signal- The averaged information gain 
provides thus an upper bound for the mutual informa- 
tion. Moreover, applying a weak Gaussian signal in the 
limit t s /ti — > one can show that the difference be- 
tween the mutual information and the averaged informa- 
tion gain in (18) is of order 0(A 4 ), where A denotes the 

r.m.s. amplitude of signals A = (V s 2 (t)) si gna i- On the 
other hand, it is shown below that the averaged informa- 
tion gain per unit time is of the order 0(A 2 ) and does not 
depend, within the given lowest order approximation, on 
other statistical parameters of signal. Thus, the upper 
bound for mutual information in Eq. (Hq) can indeed 
be achieved with an accuracy of 0(A 2 ). This fact opens 
a way to calculate the informational capacity for weak 
signals |p3| . 

The information gain can be evaluated from Eq. ( |17| ) 
without further problems. By differentiating /Cj , [/[T^] 
with respect to T we find following to the reasoning de- 
tailed in Appendix B the remarkable simple, main result 
for the rate of information gain, i.e. 



diCt[i\v; 

dt 



k J2 M*)k( 



~k a {t) 

ka(V ) 



ct—o,c 

-k a (t) + k a {Vo)]P & {t) , 



(19) 



wherein k a (Vo) denote the stationary transition rates in 
the absence of signal. Together with Eq. (fil) this equa- 
tion completely determines the information gain within 
the considered two-state model for any applied signal 
V s (t). For the case of a periodic signal V s (t) (conven- 
tional SR), or a stochastic stationary signal (aperiodic 
SR), one should average additionally Eq. ([H)]) over the 
signal fluctuations and to take the limit t — > oo. In do- 
ing so, Eq. (09) yields the stationary rate of information 
gain. For weak stochastic signals this quantity also de- 
fines the informational capacity [B3| 



C« lim UCt[I\Vs]) /T 

T— *oo \ / signal 



(20) 



If the signal is deterministic and has a finite duration, 
one obtains the total information gain K by integrating 
Eq. (|19|) in the range from to oo. 



V. STOCHASTIC RESONANCE IN SINGLE K+ 
ION CHANNELS 

In the following we apply our developed information 
theory concepts to investigate SR in a K + ion channel. 
We restrict our treatment to the case of weak signals with 
a time duration which strongly exceeds the autocorrela- 
tion time of current fluctuations tj. Then, Eqs. ( |l9| ) and 
(El) yield after some elementary calculations in the lowest 
order of V s (t), 



d!Ct[I(t)\Vs(t)] 
dt 



R(V ,a)V s \t) 



(21) 



where the form factor 



RiVo ' a) = 8 K k (V ) + k c (Vo) 



P 2 o(Vo) + P 2 c (Vo) , (22) 



depends - via the rates k a (Vo) - on the static voltage 
Vq and on the r.m.s. noise amplitude a. In Eq.(f22[), 
Pa(Vo) = 2-^ r \n[k a (Vo)], a — o,c, and the noise aver- 
aged rates fe ( c )(Vo) are given in the Appendix A for a 
K+ channel in Eqs. (|Aj) and (|A3|). 

In the case of stationary stochastic signals or for a pe- 
riodic driving, Eq. ( |2l|) provides after stochastic averag- 
ing, or averaging over the driving period of applied volt- 
age V s (t) , respectively, the stationary rate of information 
gain. For signals of finite duration the total information 
gain is directly proportional to the total intensity of sig- 

nai^=r o °°y s 2(t)dt, 



K = R(V 0) <t)S. 



(23) 



As a result we find that weak signals of the the same 
intensity £ produce equal information gains. The occur- 
rence of three different kinds of SR behavior, i.e., peri- 
odic, aperiodic, and nonstationary SR clearly depends on 
the behavior of the form function i?(Vo,er) vs. the r.m.s. 
noise amplitude a. We recall that the static voltage 
(membrane potential) Vq controls whether the ion chan- 
nel is on average open or closed, cf. FigJB. In Fig. pi we 
depict the behavior of the function R(Vq, a) vs. the r.m.s. 
noise amplitude for different values of the applied static 
voltage. If the K + ion channel is closed on average we ob- 
serve that the information gain becomes strongly be am- 
plified by noise, and even can pass through a maximum, 
i.e. SR occurs , cf. Fig. 2a. In contrast, when the station- 
ary probability for an open channel P = k /(k + k c ) 
becomes appreciably large, the addition of an additional 
dose of noise can only deteriorate the detection of sig- 
nal. As a result, the information gain decreases mono- 
tonically with increasing noise amplitude, cf. Fig. 2b. 



This no-SR behavior occurs already at a static bias of 
V « -49 mV yielding P w 0.08. Note also, if the 
channel is predominantly open, the information gain be- 
comes practically insensitive to the external noise, cf. the 
bottom curve in Fig. 2b. Although the information gain 
can slightly be increased versus the noisy intensity in this 
case (Vo = —20 mV), this effect is hardly of importance 
because the overall information gain diminishes drasti- 
cally with increasing the static voltage Vo (see Fig. 2b). 
The occurrence of SR in the considered single ion channel 
thus requires that the channel is predominantly resting 
in its closed state. 



VI. CONCLUSIONS 

Let us now summarize the main results of this work. 
We have studied an illustrative two-state model for a sin- 
gle ion channel gating dynamics from an information the- 
oretic point of view. The channel serves as an information 
channel transducing information from the applied time- 
dependent voltage signal to the ion current fluctuations. 
Three different information theory measures have been 
developed to characterize stochastic resonance. From our 
viewpoint it is advantageous to use an information mea- 
sure which is independent of time resolution At. We ar- 
gued that the rate of information gain constitutes a uni- 
fied characteristic measure for periodic (conventional), 
aperiodic and nonstationary stochastic resonance. For 
conventional (periodic) SR and aperiodic SR this mea- 
sure yields the averaged information gain per unit time. 
Moreover, for weak stochastic signals it gives also the in- 
formational capacity, i.e., the maximal mutual informa- 
tion which can be transferred per unit time for random 
signals with a fixed r.m.s. amplitude. The concept of 
information gain can also be applied to the case of non- 
stationary deterministic signals with finite duration, i.e., 
nonstationary SR, cf. Eqs. (E2), (p3|). 

Our main result is the closed formula for the rate of 
information gain in ( |l9| ) : it can be evaluated in a straight- 
forward manner by using the corresponding probabilities 
of the two-state gating dynamics in (Fy). The information 
gain itself follows upon a time integration. In presence 
of weak driving we derived handy analytical results given 
in Eqs. (pTj) , (E2h, and (|3|). For voltage input signals 
referring to a stationary process the averaged rate of the 
information gain is determined by the r.m.s. amplitude 
of the signal input and by the form factor R(Vq,ct). In 
the case of a nonstationary signal of finite duration, the 
total information gain is the product of this very form 
function and the integrated signal intensity £. 

The experimental procedure of determining the rate of 
information gain can be formulated along the lines used 
for the r-entropy in Ref. [gTJ . First, one finds the cor- 
responding probability histograms in the presence and 
in the absence of signal and then evaluates the informa- 
tion gain for the related binary stochastic chains. Natu- 



rally, this so obtained information gain will still depend 
on the time resolution At. However, in contrast to the 
T-information, this experimentally determined informa- 
tion gain should exhibit a much weaker dependence on 
the time resolution At. By using increasingly smaller 
time grids At, the experimentally obtained rate of infor- 
mation gain will approach a definite value. 

Our theoretical results have been applied to investigate 
the phenomenon of stochastic resonance in a potassium- 
selective Shaker IR ion channel plfl , as depicted with in 
Fig. 2a, b. Interestingly enough, we find that periodic, 
aperiodic or nonstationary SR for this sort of ion channel, 
as quantified by the rate of information gain, is exhibited 
only for a situation in which the channel resides on aver- 
age in the closed state. This type of behavior is rooted in 
the asymmetry of two rates k and k c ; with k depicting 
a characteristic steep, threshold-like behavior, cf. Fig. 1. 

Our SR-feature is similar to the study of parallel SR in 
an array of alamethicin channels |1C|], although the two 
situations are, however, not directly comparable. We 
note that the amount of transmitted information cru- 
cially depends on the membrane potential Vq. For the 
studied model, the information transfer is optimized at 
zero noise level near Vo ~ — 46 mV when the opening 
probability becomes appreciable (note the upper curve 
in Fig. 2b). However, under such optimal conditions the 
addition of external noise has the effect of only further 
deteriorating the rate of information transfer (Fig. 2b). 
Upon further increasing the static bias Vo the ion chan- 
nel probability to stay open increases. The rate of infor- 
mation transfer then diminishes and becomes practically 
insensitive to the input noise level. 

These results hopefully will motivate researchers to 
measure the predicted SR behavior in single potassium 
ion channels. Ever since the discovery of the SR phe- 
nomenon, the quest to use noise to optimize and control 
the transduction and relay of biological information has 
been one of the Holy Grails of SR research. Given this 
challenge, such and related experiments are much needed 
in order to settle the issue in question. 
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APPENDIX A: MODEL FOR AVERAGED 

TRANSITION RATES IN A POTASSIUM 

CHANNEL 

The opening and closing rates for the effective two- 
state model can be found from the voltage-dependent 
average dwell times. The latter can be determined from 



the experimental recordings. The experimental depen- 
dence of the effective transition rates on voltage Vb for 
the potassium-selective channel Shaker IR embedded in 
the membrane of a Xenopus oocyte at fixed temperature 
T = 18 °C have been fitted [§|,|l| by a Hodgkin-Huxley 
type of data parameterization pijj . This corresponding 
fitting procedure yields 



k c (V) = ai e-" lV , 01 = 0.015, h = 0.038, 



(Al) 



ko(V) = I ° 2 ^3 3) , a 2 = 0.03, b 2 = 0.8, V 2 = 46, 

which are depicted in Fig. pi Note that we replace the 
original fit of the closing rate k c in [ p2|j2l| by a new ex- 
pression in Eq. (Al). Unlike to |22], our fit of experimen- 
tal data in E2] is valid now also for positive voltages V. 
One should emphasize, that the two rates in Eq. (Al) are 
strongly asymmetric with respect to their dependence on 
voltage. In particular, the opening rate k (V) depicts a 
steep, threshold- like behavior, see Fig. 1. In this work 
we explicitly use these experimental findings in our cal- 
culations. The rates in Eq. ( |A1[ ) are measured in msec -1 
and the voltage in mV. According to our model study, the 
input voltage reads V = Vq + V n (t) when no additional 
signal is applied. These Eqs. (Al) must be averaged 
over the realizations of V n (t) to obtain the noise aver- 
aged rates k (Vo) and k c (Vo). For a Gaussian voltage 
noise V n (t) this averaging of the exponential in the first 
equation in (Al) is governed by the second cumulant, 
yielding 



k c (V ) = a ie b '^ l 2 -W% 
where a = (V^(i)) 1 / 2 . The averaged opening rate 

1 



(A2) 



k (V Q ) 



a 2 (V Q + V 2 +y) _j4 

e za 1 ay (A3) 



y/2^a- ./_„ 1 - e- b *( v °+V*+y) 



unfortunately cannot be analytically simplified further. 
However, this rate along with its derivative dk {Vg) / dVp 
can readily be evaluated numerically from Eq. (A3). 



APPENDIX B: CALCULATION OF ENTROPY 
AND INFORMATION GAIN 



The index a in Eqs. (|Bl|), ( ]B2| ) takes the values a = o, c; 
and the index a takes the value a = o, if a = c, and vice 



versa. Using Eqs. (Bl), (|B2|) one can check that P ( c ) 
given in Eq. (||) do satisfy Eq. (|l|). 

Furthermore, let us consider the r-entropy in Eq. (H2) 
as a sum of two contributions, SV[£|U S ] = k ^2 a=0 „ S a Jt), 
with S a (t) defined from the corresponding partitioning 
i n E q. ( ^2[). Then, using repeatedly the relationships 
(Bl) and (|B2|) we obtain after some straightforward, but 
lengthy calculations 



dt 



S (t)= -k c (t)S (t) + k (t)S c (t) 

+ k c (t)P (t) ~ k {t) ln(fc (t)Ar)P c (i) (B3) 



and 



-S c (t)= -k (t)S c (t) + k c (t)So(t) 
dt 



ko(t)P c (t) - k c (t) Hkc(t)A T )P (t). (B4) 



The addition of Eq. (g3j) and Eq. (|B4|) then yields Eq. 
(|l4|). Likewise, splitting the information gain /Ct[l|V^] in 
Eq. ( [Tt| ) into the sum of two contributions, /CJ/I V s ] = 
n^2 a=0 c K a (t), and invoking the properties flBl| ) and 
(p32j) we obtain after some algebra 



!*•» 



-k c {t)K {t) + k (t)K c (t) 
-[k c (t)-k c (V Q )]P (t) 

+k (t)ln(p$ T )p c (t) 



and 



dt 



K c {t) 



fc o (u ; 

-k (t)K c {t) + k c {t)K (t) 

-lko(t)-ko(V )]Pc(t) 



(B5) 



(B6) 



Adding Eq. ( |B4[) and Eq. ( |B5|) results after multiplying 
with n in our main result in Eq. (19). 



The purpose of this Appendix to provide the readers 
with some details of calculation of the entropic measures 
for the continuous time random point two-state process 
considered in this paper. First, we note two useful prop- 
erties of the multi-time probability densities which can 
be established from Eqs. (0), (@). Namely, 



dt 
and 



'?(*, 



,T 1 ) = -k & {t)Q a 8 (t,T s ,..,T 1 ), s>0, (Bl) 



Q?(*,*,T 4 ,_i,..,ri) = fc a (t)Qf_ 1 (t,r._i,..,ri), s > 1. (B2) 
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FIG. 1. Voltage dependence of the opening rate, k , and 
the closing rate, k c , for a K + ion channel vs. a static voltage 
Vo (solid lines), cf. Eq. (Al). The corresponding probability 
for the channel in the open state is depicted by the dotted 
line. 
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FIG. 2. Information gain versus r.m.s. amplitude of ex- 
ternal noise a at various static bias voltages Vo- The form 
function R(Vo,<j) in Eqs. (19)-(21) is plotted vs. the r.m.s. 
noise intensity a. 
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